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Th«e  Hu  win  Engineering  Division  of  the  Air  Force 
Aerospace  Medical  Research  Laboratory  (AFAMRL)  has  used 
Bun~in-th«-ioop  siauiations  to  investigata  human  factors 
probieas  possd  6y  aacta^coaputer  interactions  in  proposed 
weapon  systea  concepts.  Two  ot  the  systea  contexts  in 
which  coaputer-based  siau  la  lions  have  been  used  are  cos- 
aand-cont rol  and  digital  avionics.  Two  caaaand-controi 
experiasnts  and  one  cockpit  design  exper leant  will  be 
suaaarizad  in  this  paper.  The  final  section  of  the  paper 
is  concerned  with  generic  principles  for  u*er-orient«d 
aan-coBputer  systea  design.^. 

SURVEILLANCE  FUNCTION  SIMULATION 


This  siaulation  was  programmed  on  an  IBM  caaputer 
coapiex  which  included  four  graphic  dlaplay  units  snd  an 
anaiog-to~digitai  conversion  espabiiity.  The  caaplex  was 
configured  to  provide  real-tiae  caaaand-controi  systea 
siaulstions  for  research  purposes  (1).  The  surveillance 
function  progroa  used  approximately  145K  bytea  of  core  and 
operated  on  a  10-d-s ecund  recurrence  cycle,  which  approxi- 
Bated  radar  antenna  scan  rates. 

The  purpose  of  this  siaulation  was  to  represent  elr 
surveillance  capabilities  bssed  on  t iae-coapressed ,  digi¬ 
tized  radar  returns  which  formed  "trails”  corresponding  to 
aircraft  flight  paths.  Through  psraaetric  control  the 
simulation  could  be  tailored  to  represent  a  variety  of 
surveillance  systea  configurations.  The  configuration  used 
in  experiments  to  be  suosarized  below  was  patterned  after 
the  USAF  Air t>orne  Warning  and  Control  Systoa  (AWACS).  It 
allowed  up  to  four  operators  to  perform  the  surveillance 
function  simultaneously  via  the  four  graphic  display  units. 

Simulation  parameters  which  could  be  manipulated  as 
independent  variables  included  time  of  radar  return  entry, 
location  of  entry  and  exit,  speed  of  trail,  length  of  trail 
or  "history,"  and  type  of  return,  i.e.,  friendly  aircraft, 
search  (unidentified  aircraft),  or  false  report  (clutter). 

The  parameters  could  he  combined  to  represent  different 
enemy  attacx  strategies,  target  introduction  rates,  and 
false  report  densities.  Radar  teturn  errors  snd  bllp/scsn 
ratios  also  could  be  varied  statistically.  Surveillance 
crew  size  and  workload  allocation  could  also  be  changed  as 
inaependent  variables. 

The  simulated  radar  returns  took  the  form  of  "blips," 
or  short  dasnes,  illuminated  on  the  CRT  display.  Radar 
trails  were  presented  in  ripple  fashion,  with  the  oldest 
return  in  the  history  presented  first  snd  followed  succes¬ 
sively  by  note  recent  returns.  The  operator  was  required 
to  initiate  automatic  tracking  on  "target"  returns  by  "light- 
penning"  the  most  recant  return  and  assigning  a  numeric 
signature  via  keyboard  entries.  A  vector,  or  track,  was 
automatically  displayed  at  the  last  return  to  Indicate 
heading  (by  orientation)  and  velocity  (by  length). 

When  automatic  tracking  failed  (in  accordance  with 
programmed  statistical  parameters),  the  operator  performed 
"track  maintenance"  by  repeating  the  Initiation  procedure. 

The  need  for  track  maintenance  occurred  when  the  track 
(vector)  "drifted"  out  of  association  with  the  treil. 

Experiment  Psalm 


One  of  severel  human  factors  studies  accompli shad  with 
tha  computer-based  surveillance  simulation  involved  the  use 
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of  university  students  extensively  ttalnad  on  the  slnula- 
clon  to  Invaatlgate  the  affect,  of  trail  length,  blip  scan 
ratio  (number  of  scan,  on  which  a  return  Ma  received  from 
a  target  aircraft  divided  by  the  totel  number  of  scans), 
and  crew  slae  (2).  The  experiment  design  was  a  three- 
factor  factorial  with  four  replications.  Three  levels  of 
each  were  Investigated:  trail  lengths  of  five,  seven,  snd 
nlns  returns;  blip  sesn  rstlos  of  .5.  .7,  snd  .9;  crew 
sixes  of  one,  two,  and  three  operetort. 

Each  experimental  trial  was  comprised  of  s  2B-mlnute 
mission.  Simulated  aircraft  sntsrsd  s  200  x  200  nautical 
■lie  tut  veil  lance  area  at  an  average  rete  of  two  per  minute 
(standard  deviation  -  .75  per  minute)  it  an  average  speed 
of  500  knots.  Radar  return  error  was  programmed  as  a 
Rayleigh  distribution  with  a  standard  deviation  of  one 
nautical  mile.  Probability  of  track  failure  (drift  out) 
waa  .15  and  tha  falae  report,  or  "clutter"  rate  was  two  per 
seen  per  point  of  trail  history. 

Tha  efficiency  of  curve  11  lance  performance  waa 
aaaaaacd  via  a  nuaber  of  automatically  recorded  dependent 
variables.  These  measures  Included:  Initiation  time  for 
each  trail,  percent  of  trails  Initiated,  percent  of  trails 
reinitiated  or  aaintained  correctly,  and  percent  of  aeons 
with  good  tracking.  First  good  Initiation  was  calculated  by 
subtracting  tha  tins  of  tha  scan  on  idileh  the  return  from  an 
aircraft  appeared  on  the  display  from  the  time  of  the  scan 
during  which  an  cffnctlve  initiation  of  automatic  tracking 
was  achiavsd.  These  values  were  ■■■mad  snd  divided  by  the 
totel  aircraft  entering  tha  "curve  11  lance  area"  to  obtain  a 
neon  Initiation  time  score  for  each  2B-mlnuta  eeetlon. 
Fercent  of  aircraft  correctly  Initiated  was  determined  for 
each  session  by  dividing  the  total  number  of  aircraft  trails 
on  which  automatic  tracking  was  nffoctlvoly  initiated  at 
least  ones  by  the  total  nunbnr  of  aircraft  idileh  entered  tha 
aurvell lanes  area.  Percent  of  acans  with  good  tracking  wae 
the  ratio  of  the  number  of  acans  with  good  tracking  (correct 
track  and  signature  block,  correct  heading,  etc.)  on  each 
aircraft,  summed  across  all  aircraft  passing  through  tha 
surveillance  area,  to  the  number  of  icons  made  on  each 
aircraft  summed  across  ell  aircraft  entering  the  area  during 
the  aeasion. 


Analyses  of  variance  were  used  to  teat  for  significant 
effects  of  the  independent  variables.  The  effects  of  crew 
sire  end  btip(ecan  ratio  were  statistically  significant  for 
ail  dependent  measures.  The  effect  of  trail  length  waa  not 
significant  for  any  dependent  variable.  There  waa  only  one 
significant  Interaction.  In  terns  of  percent  of  scene  with 
good  tracking,  increasing  the  trail  length  Improved  per¬ 
formance  it  the  lower  bllp/acan  ratios. 

The  surveillance  simulation  study  was  subsequently 
replicated  with  similar  result!  using  axperienced  military 
air  surveillance  personnel  (3).  The  principal  difference 
was  that  statistical  significance  of  main  ef facta  was  found 
for  more  dependent  measures  with  the  civilian  subjects. 

The  main  effects  of  craw  alts  and  blip  scan  were  statis¬ 
tically  significant  for  civilian  subjects  but  not  for  the 
military  for  tha  percent  of  aircraft  Initiated  variable. 

On  the  othar  hand,  in  tana  of  tha  aama  dependant  measure, 
trail  length  produced  a  significant  affect  for  tha  mili¬ 
tary,  but  not  for  tha  civilian  subjects.  The  difference  In 
craw  alia  affects  waa  largely  attributable  to  failure  of 
the  military  to  uea  a  third  craw  member  to  ea  twch  advan¬ 
tage  as  civilians  did.  Effective  allocation  of  survell- 
lanca  subtasks  waa  batter  achiavsd  by  tha  civilians. 
...probably  because  they  had  more  experience  in  working  In 
three-nan  groups  at  the  aurvell  lance  teak. 
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U  t«CM  of  tho  8 rand  .  the  military  subjects 

took  35  aacoada  to  4otoct  ad  Initiate  automatic  tracking 
om  aircraft  trail  a.  Tho  rage  we  from  40  aacoada  for  a 
tkroo  —  crow  with  a  .9  blip /sea  ratio  to  76  aacoada  for 
a  oao" maa  crow  with  a  .5  blip/aa.  Comparable  values  for 
ciwiliaa  subjects  ware  a  graad  maaa  of  58  aacoada  and  a 
raofi  of  37  to  86  aacoada  for  tha  corresponding  crow 
aiao-bllp/ocaa  ratio  cooblaatloaa. 

for  overall  parcaex  of  acaaa  with  food  tracking  tha 
graad  oeaoo  vara  41  aad  43  percent  for  military  aad  civil¬ 
ians,  rapect  Ively.  Again,  tha  estraaaa  for  tha  ranges 
occur rad  at  tha  aano  crow  oiaa-blip/acaa  ratio  cooblnatlona 
aa  for  first  good  initiate  tlaaa  and  ware  44-34  percent  for 
tha  military  versa  48-36  percent  for  tha  civilians. 

In  terao  of  parcaataga  of  targets  detected  aad  ini¬ 
tiated,  tha  heat  performance  was  achieved  by  tha  civilians 
and  occurred  at  tha  .9  bilp/acan  ratio.  Tha  percentages  of 
targets  detected  ware  94,  95,  and  98  for  one-,  two-,  and 
three-man  crews,  respect Ively.  The  worst  performance 
occurred  with  a  .5  biip/acan  at  which  civilian  and  military 
one-  and  two-wen  teams  were  equivalent  (87  and  90  percent, 
respectively).  Military  three-man  teams  detected  only 
91  percent  of  the  targets  at  the  .5  bllp/ecan  level,  whereas 
civilian  three  men  teens  detected  94  percent,  which,  you 
will  note,  is  equivalent  to  one-man  team  performance  with  a 
.9  blip/ecan  ratio. 

Even  though  there  were  discrepancies  between  military 
end  civilian  subjects,  the  nature  and  extent  of  tha  varia¬ 
tions  were  not  sufficient  to  Invalidate  conclusions  drawn 
from  research  based  on  perforaance  of  trained  civilian 
subjects  using  the  surveillance  system  simulator.  The 
dlfferemces  were  attribwted  to  the  civilise  subjects' 
greeter  familiarity  with  the  simulation.  Therefore,  the 
eaperimemts  confirmed  the  utility  of  research  with  the 
alow  let  ion  for  determining  a*  time*  mines  of  hardware  end 
crew  capabilities  and  methods  for  effectively  allocating 
functions  among  crew  members. 

WRAFOMS  PmCTlOM  SiMBLATKHI 
gechnrouad 

the  seme  compote*  simulation  campion  described  above 
also  was  used  to  investigate  human  engineering  design  ques¬ 
tions  related  to  men  computer  interaction  in  the  wnepoee 
direction  faction  of  41  r  force  command  control  a  ye  tame. 

Tho  relationships  between  workload  end  date  entry  node  were 
of  special  concern  to  system  designers  and  users.  Users  had 
strong  preference  for  "light  guns'*  or  light-emitting  pane 
for  linking  date  to  targets  at  the  graphics  interface.  On 
the  other  hand,  the  wee  of  e  cursor,  deputed  om  the  graphic 
display  end  controlled  vie  e  creek  bell  or  Joystick,  offered 
possible  advent ages  in  accuracy  of  Indies t Iona  end  hardware 
coots.  Cone aquae tly,  e  weapons  direction  teak  simulation 
wee  developed  end  weed  to  experimental ly  evaluate  the 
alternatives  (4,  5). 

The  weapons  direction  scenario  was  developed  by  an 
experienced  weapons  director  working  with  computer  pro¬ 
grammers  end  research  scientists.  The  teak  which  resulted 
required  the  weapons  director  eubjocte  to  dlroct  as  many  aa 
10  friendly  interceptors  or,  fighters,  against  attacks  by 
enemy,  or  "fetor ,M  bombers.  Three  leveU  of  attack  were 
invest igated:  e  single  "wave"  of  16  bombers,  two  waves  of 
20  bombers  each,  end  one  wave  of  40  bombers.  Bombers 
entered  from  the  west,  or  left,  of  the  200  200  mile 

surveillance  area  represented  on  the  CRT  end  flew  easterly 
toward  e  bomb  roloaee  line  (8RL)  on  the  right  about  185 
miles  from  the  entry  lime.  Bombers  entered  at  500  knots 
airspeed  end  40,000  feet  altitude.  (Bomber  altitude  varied 
from  time  to  tine  according  to  e  "canned"  program.) 

rive  interceptors  were  "In  the  air"  at  the  simulation 
•tort  end  were  flying  at  10,000  feet  altitude  and  500  Imote 
airspeed.  Fire  additional  interceptors  wore  available  to 
tha  meposu  director  (W0)  "on  the  ground"  end  were  repre¬ 
sent  ed  by  am  appropriate  symbol  to  tho  right  of  the  BRL. 

To  "scramble"  a  fighter  the  W0  had  to  designate  it  with  the 
light  pen  or  cursor.  Tho  W0  could  also  "call  for"  changes 
la  fighter  altitude  or  airspeed  vie  appropriate  keyboard 
eat  rise  end  light  pea/cursor  designations.  Such  changes 


were  accompanied  by  appropriate  variations  In  fuel  use 
rate,  lech  filter  had  4500  pounds  of  fuel  at  a  too  let  toe 
onset.  4  computer  programed  algorithm  controlled  the  fuel 
use  rate  which  varied  as  a  function  of  flghtor  speed  end 
altitude  In  auch  a  ay  that  tha  maximum  flying  time  of 
44  minutes  wee  achieved  at  10,000  fat  altitude  ad 
180  toots.  The  minimum  flylog  tine  we  IS  minutes  at 
40,000  feet  ad  1080  knots.  One  minute  before  fuel  level 
reached  the  minimum  required  for  return  to  BRL,  an  F 
eppared  In  the  f Ighter' e  symbology  block. 

The  WD  primary  tak  as  to  use  the  fighter  to 
intercept  ad  da  troy  the  attacking  bomber  e.  In  doing  his 
Job,  the  WD  could  Insert  date  which  would  remit  in  heeding, 
altitude,  or  velocity  chage;  commitment  or  decani tant  to 
interception  of  a  particular  bomber;  or  display  of  remaining 
amount  of  fuel  ad  current  velocity  in  the  alphaumeric 
symbology  block. 

Upon  being  paired  with  e  bomber,  an  Interceptor  ms 
maintained  on  course  autonat  icaiiy  by  e  programed  intercept 
algorltto  at  11  within  "kill"  rage,  which  Included  the 
requirement  that  both  aircraft  be  at  the  sea  altitude. 
Altitude  dlscrepacles  resulted  In  automatic  "de-commit¬ 
ment."  Otherwise,  a  "kill"  «u  credited  with  a  probability 
of  .75;  i.e,  in  a  random  anner,  one  out  of  every  four  tlas 
"kill"  rage  requireante  are  at,  s  de-commitaot  occurred, 
in  accordance  with  apart  ee  time  tee  of  the  frequency  with 
which  "nisas"  night  be  expected.  A  "kill"  as  signalled  by 
an  "X"  at  the  bomber  position. 

Experiment  Design 

The  principal  independent  variable  mi  date  entry  mode: 
light  pen,  track  ball-  or  force  stick-controlled  curmr. 

The  light  pen  and  as  the  conventional  device  provided  with 
the  IBM  2250  graphics  display  systen.  The  track  bell  ad 
force  stick  are  atadard  catrol  devices  procured  fra  "off 
the  shelf"  stock.  The  principal  depadent  variables 
included  mmbsr  of  bombers  "killed,"  average  distance  fra 
BRL  at  kill,  amount  of  fuel  used,  ad  number  of  operator 
actions.  Four  aper lanced  Air  Force  aapoa  directors 
served  as  subjects  in  a  repeated  measures  exper leant. 

Rea  its 

Analysis  of  variance  showed  that  the  aln  effect  of 
date  entry  node  was  sign  if  leant  (p  <  .01)  for  3  of  the  4 
principal  dependent  variables.  The  aln  effect  of  worfcloed 
(number  of  bombers)  was  elgnif leant  for  ell  four  dependent 
variables. 

The  light  pen  cons  is  tally  ahead  advent  ogee  over  the 
ether  ta  date  entry  nodes  end  the  track  bell  was  better 
tha  the  force  stick  arc  often  tha  not.  The  aperlority 
of  the  light  pa  wee  greatest  wha  the  work  load  was 
heaviest,  i.e.,  dtm  there  are  40  bombers  to  be  lnter- 
cepted.  The  advent age  was  attributable  to  the  greeter 
speed  with  which  date  a try  actions  could  be  takeo  with  the 
light  pa  node. 

Mem  numbers  of  the  bombers  destroyed  prior  to 
r aching  the  BRL  ere  ehoa  In  Table  l.  Averaged  serose  the 
thra  ark  load  lea  la,  the  WDs  obtained,  on  the  eve  rag*, 

91,  83,  ad  75  percent  "kills"  ader  the  light  pm,  track 
bell,  end  force  stick  cadltlone,  respectively.  The  WDs 
are  least  effect  la  In  dealing  with  one  aa  of  40 
bombers,  obtaining,  on  the  average,  78  percent  kills  as 
compared  to  82  percent  ad  99  percent  kills  for  ta  waves 
of  20  and  one  wave  of  16,  respect ively. 

Table  2  shows  the  average  distance  (alias)  from  the 
BRL  at  which  "kills"  are  made  for  tach  experimental  condi¬ 
tion.  Again,  note  that  tbs  grenteet  advantage  me  for  tffe 
light  pea  over  the  trak  bell  wee  at  the  two  higher 
workloads. 

Table  3  shows  asm  for  pounds  of  fuel  and  by  the 
interceptors.  The  Increased  epe.*d  with  which  information 
wee  transmitted  to  fighters  vie  the  Light  pen  made  wee 
reflected  In  lees  flying  time,  fewer  lnstanca  of  high 
speed  chases,  end  henee,  reduced  fuel  as.  The  differences 
are  statistically  significant  between  light  pen  end  track 
bell  end  between  light  pen  end  force  stick. 
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Mam  Cor  tha  number  of  act  Iona  laic  lot  ad  by  UDs  par 
experimental  condition  ora  shown  in  Tabla  4.  Xt  was  prl- 
nariiy  tha  incraaaad  tins  raquirad  to  execute  cursor  nova— 
meats  which  raatrictad  tha  affactivsaass  and  afficiancy  of 
WDa  in  achieving  tha  niaaioo  object iva  with  tha  track  bail 
and  forca  stick  nodes.  Hots  that  under  tha  Ib-bonbsr 
attack,  where  of fectlvenesa  varied  little  across  data  entry 
nodes,  the  a unbar  of  operator  actions  varied  little  across 
nodes. 

The  added  efficiency  of  tha  light  pan  is  reflected 
batter,  perhaps,  by  Tabla  5,  which  shows  tha  average  action 
rata  (number  of  actions  per  10-sacond  conputer  update 
interval)  for  each  condition.  The  track  ball  and  fores 
stick  action  rates  were,  respectively,  32  percent  and 
4b  percent  lass  than  tha  average  light  pen  rats. 

Obviously,  tha  speed  with  which  tha  data  entry  nodes 
are  used  could  have  bean,  and,  in  fact,  was,  evaluated 
without  benefit  of  tha  weapons  direction  simulation.  Tha 
advantage  of  accomplishing  tha  test  within  tha  context  of 
the  system  simulation  was  in  being  able  to  relate  dif¬ 
ferences  to  overall  system  effectiveness  in  terns  of 
critical  aystea  performance  criteria  and  operating  costs  and 
under  a  range  of  environnsntai  conditions. 

TABLE  1.  PERCENT  OF  BOMBERS  DESTROYED 


Workload  (Mo.  Waves/ Bombers  per  Wave) 


U.I.  Entry  Hod* 

1/16 

2/20 

1/40 

Light  Pen 

16.00 

36.75 

34.75 

Track  Ball 

16.00 

33.00 

30.75 

Force  Stick 

15.75 

28.25 

28.00 

TABLE  2.  AVERAGE  DISTANCE  FROM  BOMB 

EE LEASE  LINE  AT  "KILL"  (alia.) 

Workload 

(No.  u.v«./iaab«r.  nar  Wav.) 

Date  Entry  fed* 

ms 

2/20 

ms. 

Light  Pea 

107 

78 

72 

Track  Ball 

90 

59 

55 

Forca  Stick 

82 

47 

50 

TABU 

3.  AVERAGE  AMOUNT  OF  FUEL  USED 

(Thousands  of  Pounds) 

Workload 

(No.  W*v«./l<mb«r*  nar  W.v.) 

Data  Entry  Mode 

1/16 

2/20 

1/40 

Light  Pen 

11 

24 

24 

Track  Bail 

18 

33 

27 

Force  Stick 

19 

31 

29 

TABLE  4. 

AVERAGE  NUMBER  ACTIONS 

INITIATED 

BY  WEAPONS  DIRECTORS 

Workload 

(No.  Waves/ Bomba rs  per  Wave) 

Data  Entry  Mode 

l/U 

2/20 

1/40 

Light  Pen 

83 

161 

152 

Track  tail 

93 

130 

107 

Force  Stick 

86 

104 

96 

TABLE  5.  AVERAGE  WEAPONS  DIRECTOR  ACTION 
INITIATION  RATE 

(Actions  per  10- Second  Interval) 

Workload  (Mo.  Waves/Bombera  per  Wave) 


Date  Entry  Mode 

1/16 

2/20 

1/40 

Light  Pen 

1.2 

1.1 

1.2 

Track  tell 

0.9 

0.8 

0.7 

Force  Stick 

0.7 

0.6 

0.6 

COCKPIT-DIGITAL  AVIONICS  SIMULATION 
Background 

The  evolution  of  compact  digital  computers  hes  made 
possible  the  developnent  of  digital  avionics  infornstion 
systems.  Such  systems  promise  s  number  of  advent ages  to 
both  aircraft  deslgnara  and  usars  (6).  For  example,  when 
interfaced  with  multipurpose  cathode  ray  tubs  displays  and 
multifunction  switches,  digital  computation  and  storage 
capabilities  can  be  used  to  reduce  the  number  of  dedicated 
instruments  competing  for  cockpit  panel  eras.  Information 
which  is  not  required  by  the  pilot  on  s  continuous  or  fre¬ 
quent  basis  can  be  stored  end  presented  on  demand  either 
automatically,  as  related  programmed  mission  events  tran¬ 
spire,  or  in  response  to  nenual  control  actions.  And  with 
reduced  demands  for  panel  space.  It  will  be  easier  to  locate 
the  multipurpose  controls  end  displays  in  print  reach  end 
viewing  ernes. 

However,  experienced  pilots  have  been  troubled  by  the 
proepect  of  possible  added  activity— both  mental  and  phys¬ 
ical— required  to  gain  accent  to  information  which  is 
normally  on  dedicated  instruments.  Should  the  demand  for 
such  activities  occur  during  peek  operator  workload,  the 
impact  on  mission  success  might  not  be  offset  by  increased 
calculating  power,  speed,  or  accuracy  afforded  by  tha 
digital  processor.  The  need  for  date  indicative  of  the 
relationship  between  multifunction  switching  end  primary 
aircraft  control  tseks  end  the  impact  on  pilot  workload 
occasioned  the  adaptation  of  the  AFAMIL  computer  complex  to 
siauists  a  digital  avionics  equipped  cockpit  (7).  Of  parti¬ 
cular  interest  wee  whether  or  not  the  naintenence  of  Inow- 
lndge  of  procedures  associated  with  multifunction  keyboard 
operation  reduced  the  operator's  reserve  capacity  for  making 
choices  or  decisions  euch  ae  might  be  required  to  handle 
contingency  situations  during  a  mission. 

The  computer-based  simulator  incorporated  three  types 
of  tasks.  Of  the  three,  two— flight  control  end  communica¬ 
tion*/ IFF  switching  funct lone— represented  actual  teaks  in 
aircraft  systmu.  The  third  wee  an  information  processing 
teak  which  served  as  a  teat  to  measure  cognitive  reserve 
capacity  under  various  primary  task  conditions. 

The  front  panel  of  the  cockpit  wee  equipped  with  three 
CRT-type  displays.  The  center  display  wee  used  to  present 
information  concerning  basic  flight  parameters  in  a  moving 
tape  format.  The  cockpit  also  contained  a  throttle  with 
afterburner  twitch  (left  side  panel)  and  e  center-mounted 
Joystick  control,  idilch  were  used,  in  combination  with  the 
displayed  flight  Information,  to  "fly"  various  maneuvers. 
Printed  computer  outputs  of  simulator  performance  date 
included  both  mean  absolute  and  root  mean  square  error 
relative  to  specified  control  values  based  on  "fly  to" 
Instructions  for  altitude,  heeding,  bank  angle,  pitch, 
indicated  airspeed,  vertical  velocity,  a ngle-of -attack,  end 
g-loed. 

Between  the  front  instrument  panel  end  left  elds  panel 
wee  a  multifunction  keyboard  (NFK).  This  HFK,  in  combina¬ 
tion  with  the  CRT  on  the  upper  left  of  the  front  panel  end 
a  numerical  entry  keyboard,  also  located  on  the  instrument 
panel  (lower  left),  use  used  to  simulate  a  multifunction 
interfacn  with  digital  avionics  subsystems.  Subsystems, 
functions,  end  etetee  were  displayed  on  the  CRT  to  comple¬ 
ment  the  feedback  afforded  by  beck-projectnd  legends  on  the 
HFK  pushbutton  feces.  The  HFK  wee  used  to  control  communi¬ 
cation  and  IFF  functions  celled  for  by  scenarios  programmed 
on  the  simulator. 
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Dm  tuarn  capacity  taat  used  was  a  mUtioa  of  tba 
Star  opart  choice  react  loo  tuk  (9,  9).  This  part  Scalar 
task  was  seise tad  o«  the  Pas is  of  Its  value  for  studying 
divided  attention  of facta,  i.a,  the  tendency  for  subjects 
who  perform  two  tasks  alaultaoeouely  to  be  leas  proficient 
on  one  (if  not  both)  than  they  are  whan  performing  the 
tasks  separately  (10,  11).  The  Sternberg  task  facilitates 
localisation  of  the  divided  attest loo  effect  within  a 
four-stage  nodal  of  human  Information  processing:  encoding 
of  stimulus  information;  central  processing;  response 
decoding;  and  response  execution.  The  Sternberg  task 
allows  the  researcher  to  vary  central  processing  deseeds 
while  holding  input  end  output  requir«Mots  cons  tent.  The 
date  obtained  from  the  teak  ere  used  to  develop  a  linear 
equation  Indicative  of  the  relationship  between  response 
latency  and  tha  amount  of  uncertainty  which  must  be  reeolved 
in  order  to  select  a  response. 

Briggs  end  Swenson  (12)  found  a  linear  relationship 
between  Sternberg  teak  reaction  fine  (RT)  and  the  amount  of 
central  processing  uncertainty  (U£)  thus: 

RT  •  a  ♦  b  (HI 
c 

H  values  used  in  Che  study  of  multifunction  switching  were: 
I'roo,  1.50.  2.00,  wd  2.31  bits. 

La  the  equation  for  reaction  time  (RT) ,  the  Intercept 
constant,  a,  reflects  the  time  required  for  stimulus 
encoding,  sampling,  and  preprocessing  at  the  input  stage  of 
human  information  processing  plus  the  time  to  decode  and 
execute  a  response  in  the  output  stage;  Che  slope,  b, 
reflects  ths  time  per  test  to  complete  stimulus  classifica¬ 
tion  functions  at  tha  central  processing  stage.  Therefore, 
if  a  teak  performed  simultaneously  with  the  Sternberg  teak 
interferes  with  encoding  or  decoding  processes,  its  effect 
should  be  reflected  by  e  change  in  the  Intercept  value. 
Conversely,  if  the  interference  occurs  at  the  central  pro¬ 
cessing  stage,  the  effect  will  be  revealed  by  a  change  la 
the  slope  of  the  function. 


Date  were  derived  from  the  performance  of  four  student 
subjects  in  the  eiaiietor.  Prior  to  the  experlasnt  proper 
each  subject  ms  a  trained  on  ail  three  tasks.  Training 
sessions  lasted  2  hours  end  were  scheduled  two  to  four 
times  per  week.  Each  subject  wee  trained  until  teak  per¬ 
formance  measures  appeared  to  asymptote. 

Inch  subject  was  tested  under  six  different 
conditions:  three  single-teak  conditions  end  three  duel- 
task  conditions:  Plight  control,  MIX,  and  Stsrnberg  choico- 
r •action  task,  aions;  and  flight  controi  plus  MPK,  flight 
control  plus  Sternberg  task,  end  MFK  plus  Sternberg  teak. 
When  the  Sternberg  task  was  cosbined  with  MPK,  it  occurred 
only  during  periods  dim  the  subject  wee  awaiting  instruc¬ 
tion  for  an  MPK  task  of  e  given  difficulty  level.  This  wee 
consistent  with  the  interest  in  nsesuring  cognitive  loads 
associated  with  anticipating,  rather  than  actually  per¬ 
forming,  MPK  tasks.  Independent  variables  included  two 
levels  of  fli^t  control  task  difficulty  ("easy”  end 
"difficult”)  end  four  levels  of  MPK  task  difficulty  mea¬ 
sured  in  terms  of  ths  average  amount  of  Information  trans¬ 
mitted  vie  the  keyboard  in  accomplishing  communication*/ IFF 
factions. 


AO  analysis  of  variance  (repaated-maesures  design)  was 
applied  to  scores  obtained  for  each  condition.  Results 
fron  ths  single  task  conditions  were  ee  follows:  The 
difference  between  easy  end  difficult  flight  control  was 
statistically  significant  (p  <  .03).  The  effect  of  MPK 
task  difficulty  also  was  significant  statistically 
(p  < .001) .  Naan  task  times  (In  seconds)  end  standard 
deviations  (is  parentheses)  for  the  four  difficulty  levels 
were:  1-3.97  (0.32);  11-3.93  (0.33),  111-7.43  (0.68), 
1V-9.97  (0.93).  The  aw  rage  rate  of  in  for  net  ion  transmis¬ 
sion  vis  ths  MPK  system  varied  from  1.9  bits/eac  to 
2.6  bits/sac  across  the  fswr  levels  of  MPK  task  difficulty . 
Ths  switch  set  ism  rats  was  slightly  greeter  then  one  per 
■sc sad  on  tha  average.  The  method  of  least  squares  wee  used 
to  fit  e  straight  line  to  the  baseline  (e ingle  teak) 
Sternberg  data. 


Data  analyses  for  tha  dual-task  conditions  shewed  that 
although  msea  flight  control  error  was  greater  when  flight 
control  was  comb  load  with  MPK  teaks,  tha  differences  ware 
not  statistically  significant.  Similarly,  MPK  taak  times 
Increased  under  dual  task  conditions,  but  tha  increases  were 
not  statist icaily  significant.  Plight  control  orror  acoroe 
wsrs  virtually  identical  for  flight  control  alone  ea  compared 
to  flight  control  with  tha  Sternberg  teak.  And  tha  Sternberg 
taak  had  no  statistically  significant  impact  on  NPK  teak 
tine.  Linear  squat tone  also  were  fitted  to  Stornborg 
rempoaam  tins  date  for  each  dusl-tssk  condition  to  permit 
comparison  of  lntorcopt  sad  slops  values  with  those  obtained 
for  the  Sternberg  task  baseline  condition.  P-tests  (13) 
indicated  that  elopes  end  intercepts  for  the  flight  controi 
conditions  differed  significantly  from  those  for  the  base¬ 
line  condition,  end  Intercept  value  varied  significantly 
between  the  baseline  and  MPK  lapllclt  rehearsal  condition. 
Interpreted  in  the  traditional  manner,  those  results  indi¬ 
cated  that  the  effect  of  MPK  "lapllclt  rehearsal,"  l.e., 
maintaining  a  readiness  to  perform  anticipated  tasks,  was  In 
the  input  or  output  stage  of  information  processing  only, 
following  the  eapirical  evidence  and  logic  of  Briggs  et  el. 
(11),  the  effect  is  probably  In  the  input  stage.  The  dif¬ 
ference  in  intercept  values  amounted  to  e  12  percent  average 
increase  in  input  time  attributable  to  MPK  "implicit 
rehearsal." 

Active  flight  control,  on  the  other  hand,  involved  both 
input  end  central  processing  as  evidenced  by  differences 
from  baseline  In  both  intercept  end  slope  values  for  the 
regression  equation.  Moreover,  there  was  an  increase  in 
input-output  time  (28  percent  end  33  percent  for  easy  end 
difficult  flight  control,  respectively)  end  an  increase  in 
central  processing  rate.  The  increase  in  central  proces¬ 
sing  rate  under  the  duel -task  condition,  idilch  wee  consis¬ 
tent  with  results  obtained  by  Lyons  and  Briggs  (Briggs  et 
ei. ,  1972),  wee  attributed  to  the  subject's  conducting 
fewer  or  lees  complete  teste  of  the  probe  stimulus  under 
the  greeter  loading  conditions.  This  apparent  switch  in 
node  of  operation  in  the  central  processing  stage,  between 
single-  end  duel-task  conditions,  could  be  e  valuable  aid 
to  identification  of  significant  workload  changes. 

A  comprehensive  analysis  of  information  transmitted 
vie  the  Sternberg  teak  indicated  that  difficult  flight 
control  reduced  reserve  Information  processing  capacity  of 
the  pilot  by  34  percent;  easy  flight  control,  by  43  percent; 
anticipation  of  difficult  MFK  teaks,  by  31  percent;  end 
easy  MFK  teaks,  by  20  percent.  Thus,  although  MPK  tasks 
may  be  compatible  with  moderately  difficult  flight  control 
requlrsswnte,  they  do  place  significant  demsnds  on  cogni¬ 
tive  abilities  end  may  detract  from  the  pilot's  ability  to 
cope  with  high  workloads  in  critical  combat  situations. 
Therefore,  concerted  efforts  to  simplify  the  control /dis¬ 
play  interface  to  digital  avionics  subsystems  ere  warranted 
end  ere  probably  best  accomplished  in  computer-based  system 
simulations  which  facilitate  dewlopment  end  evaluation  In 
an  iterative  manner  end  under  a  wide  range  of  mission 
conditions. 


USER-ORiatTP)  SYSTEM  DESICH 

Although  generic  design  principles  may  be  derived  from 
simulation  experiments  like  those  described  above,  the 
studies  were  designed  to  eddresa  specific  Issues  in  parti¬ 
cular  systems.  System-specific  simulations  must  mset  at 
least  two  important  criteria:  timeliness  end  cost-effec¬ 
tiveness.  Requirements  must  be  identified  early  in  ths 
design  process  if  large  system  simulations  are  to  be 
developed  end  applied  In  a  timely  manner.  Cost-effective¬ 
ness  may  be  difficult  to  assess  with  confidence  prior  to  the 
actual  simulation  results.  Even  «d«eh  cost-effect ivenesa  ie 
assured,  system  simulation  may  be  prohibited  by  limited  - 
funding.  A  recent  workshop  (14)  on  man-computer  interface 
design  provides  some  useful  suggestions  with  regard  to 
masting  system  design  goals  within  schedule  end  cost 
constraints. 


The  application  of  a  "user-oriented"  top-down  approach 
to  computer  system  design  will  facilitate  identification  end 
resolution  of  human  engineering  design  issues  In  a  timely 
manner.  The  essence  of  such  an  approach  Is  outlined  in 
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Figure  l.  Note  that  the  approach  entails  three  basic  pro¬ 
cesses:  analysis,  synthesis,  and  evaluation.  Simulation  is 
the  vehicle  by  which  models  of  system  functions  are  exer¬ 
cised  to  obtain  inferences,  predictions,  and  evaluations 
prior  to  production.  It  is  suggested  that  current  computer 
system  design  and  evaluation  techniques  are  largely  er^lri- 
cal  and  highly  dependent  upon  the  experience  and  skills  of 
those  who  apply  them,  the  top-down  approach  is  the  bridge 
to  more  objective  and  systematic  methodology,  but  it 
requires  an  adequate  technology  base. 


»  A  Top-Odnr  a 


Man-Computer  Design  Technology 

Processes  of  the  user-oriented  top-down  approach  cannot 
be  accomplished  successfully  without  benefit  of  relevant 
data  inputs  and  structural  aids.  For  example,  analysis  of 
system  requirements  depends  upon  the  capability  to  identify 
component  tasks  and  associated  input-output  relationships. 
Hence,  the  first  requirement  to  be  mat  in  technology  base 
development  is  a  standard  taxonomy  of  Information  processing 
functions  Including  a  generic  set  of  user  tasks  and  algo¬ 
rithms  definitive  of  inter-relationships.  The  same  tech¬ 
nology  base  also  would  support  the  synthesis  and  evaluation 
processes  including  modeling  and  simulation.  It  would  also 
be  generally  applicable  to  a  wide  variety  and  number  of 
computer^ased  systems  (15). 

Man-computer  interface  design  technology  development 
requires  a  long-term  effort,  but  significant  beginnings 
have  been  made.  Computer  functions  are  relatively  easy  to 
analyse  and  measure  in  terms  of  information  theory  concepts 
and  metrics,  behavioral  scientists  also  have  applied 
information  theory  to  the  analysis  and  quantification  of 
certain  human  capabilities  (16).  Some  of  the  problems  yet 
to  be  overcome  in  relating  human  and  machine  information 
processing  capabilities  have  been  identified  and  discussed 
by  Crawford,  Topmiller,  and  Kuck  (17).  Rudimentary  efforts 
to  apply  human  performance  theory  to  the  development  of  a 
generic  set  of  human  information  processing  functions  have 
been  summarised  by  Crawford  (IS). 


The  advent  of  microprocessors.  Inexpensive  graphics, 
and  distributed  processing  now  facilitates  emphasis  on 
adaptation  of  computer  to  man.  The  costs  and  complications 
of  user  errors  and  extensive  user  training  programs,  which 
result  from  over  reliance  upon  adaptation  of  nan  to 
computer  M idiosyncrasies,**  cannot  be  justified  indef¬ 
initely.  The  "Zeitgeist”  is  right  for  concerted  efforts  to 
facilitate  man-computer  symbiosis  in  future  systems. 
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